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Abstract. We start with a (q, ^-generalization of a binomial coefficient. It 
can be viewed as a polynomial in t that depends upon an integer q, with 
combinatorial interpretations when q is a positive integer, and algebraic inter- 
pretations when q is the order of a finite field. These (q, i)-binomial coefficients 
and their interpretations generalize further in two directions, one relating to 
column-strict tableaux and Macdonald's "7 th variation" of Schur functions, the 
other relating to permutation statistics and Hilbert series from the invariant 
theory of GL n (¥ q ). 



1. Introduction, definition and main results 
1.1. Definition. The usual q-binomial coefficient may be defined by 



(1.1) 



{q;q)k ■ {q;q)n-k 



where (x;q) n := (l — q°x)(l — q 1 x)---(l — q n ~ 1 x). It is a central object in combina- 
torics, with many algebraic and geometric interpretations. We recall below some of 
these interpretations and informally explain how they generalize to our main object 
of study, the (q,t) -binomial coefficient 

a 2) H •= 

1 • ' W,/ fc! g ,f(n-fc)V 

where n\ q , t ~ (1 - t 9 " -1 )^ - t q "- q )(l - i 9 "^ 2 ) • • • (1 - 

If q is a positive integer greater than 1, the (q, i)-binomial coefficient will be 
shown in Section 4 to be a polynomial in t with nonnegative coefficients. It is not 
hard to see that it specializes to the g-binomial coefficient in two limiting cases: 



(1.3) 
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Warnings: This (q, i)-binomial coefficient is not a polynomial in q. The parameters 
q and t here play very different roles, unlike the symmetric role played by the 
variables q and t in the theory of Macdonald polynomials (see e.g. [10, Chap. VI]). 
Also note that, unlike the q-binomial coefficient, the (q, i)-binomial coefficient is 
not symmetric in k and n — k. 
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1.2. A word about philosophy. Throughout this paper, there will be (con- 
versions of various combinatorial numbers having some meaning associated with 
the symmetric group 6„. These (q, i)-numbers will have two specializations to the 
same q-version or i-version, as in (1.3). The limit as t — > 1 will generally give a 
q- version that counts some objects associated to GL n (¥ q ) when q is a prime power. 
The q —> 1 limit will generally give the Hilbert series, in the variable t, for some 
graded vector space associated with the invariant theory or representation theory 
of 6 n . The unspecialized (q, inversion will generally be such a Hilbert series, in 
the variable t, associated with GL n {¥ q ) when q is a prime power. 

One reason for our interest in such Hilbert series interpretations is that they 
often give generating functions in t with interesting properties. One such property 
is the cyclic sieving phenomenon [15] interpreting the specialization at t equal to 
a n th root-of-unity for the & n Hilbert series, and the specialization at t equal 
to a (q n — l) th root-of-unity for the GL n (¥ q ) Hilbert series. As an example [15, 
§9], the q-binomial coefficient in (1.1), when q is specialized to a root-of-unity of 
order d dividing n, counts the number of fc-element subsets of {1,2,..., n} stable 
under the action of any power of the n-cycle c — (1,2,.. . ,n) that shares the same 
multiplicative order d. Analogously, the (g, i)-binomial coefficient in (1.2), when t 
is specialized to a root-of-unity of order d dividing q n — 1, counts the number of 
fc-dimensional F g -subspaces of V qn stable under multiplication by any clement of 
F*„ that shares the same multiplicative order d. 

1.3. Partitions inside a rectangle, and subspaces. The binomial coefficient 
(£) counts fc-element subsets of a set with n elements, but also counts integer 
partitions A whose Ferrers diagram fits inside a fc x (n — fc) rectangle. The usual 
q-binomial coefficient q-counts the same set of partitions: 

(1.4) 

where |A| denotes the number partitioned by A. It will be shown in Section 5 that 
the (q, £)-binomial has a similar combinatorial interpretation: 

(1.5) 

where the sum runs over the same partitions A as in (1.4). Here wt(X;q,t) has 
simple product expressions, showing that for integers q > 2 it is a polynomial in t 
with nonnegative coefficients, and that 

(1.6) limwt(A;<7,t) = <7 |A| and lim wt(A; q, t^) = * |A| . 

t— »1 q— >1 

When q is a prime power, the g-binomial coefficient also counts the fc-dimensional 
F 9 -subspaces U of an n-dimcnsional F g -vector space V. It will be shown in Sec- 
tion 5.3 that (1.5) may be re-interpreted as follows: 

(1.7) 

where the summation runs over all such fc-dimensional subspaces U of V, and s(U) 
is a nonnegative integer depending upon U. 



n.t 



^wt(A;q,t) 



n.1 
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1.4. Principal specialization of Schur functions. The usual g-binomial coef- 
ficient has a known interpretation (see e.g. [10, Exer. 1.2.3], [22, §7.8]) as the 
principal specialization of a Schur function s\(xi, X2, ■ ■ ■ , Xn), in the special case 
where the partition A = (k) has only one part: 



(1.8) 



s {k) (l,q,q 2 ,...,q n k ). 



It will be shown in Section 6 that the (q, i)-binomial coefficient is a special case 
of a different sort of principal specialization. In [11], Macdonald defined several 
variations on Schur functions, and his 7 th variation is a family of Schur polynomials 
Sa(xi, X2, ■ ■ ■ , x n ) that lie in F 9 [xi, . . . , x n ], and are invariant under the action of 
G = GL n (¥ q ). It turns out that the principal specializations S\(l, t,t 2 , . . . , i" -1 ) 
of his polynomials can be lifted in a natural way from ¥ q [t] to Z[t], giving a family 
of polynomials we will denote S\(l, t,t 2 , . . . , i"^ 1 ). When A has a single part (k), 
one has 



(1.9) 



S(fc)(l,M 2 , • ■ • ,t n k ). 



q,t 



Recall also that Schur functions have a combinatorial interpretation in terms of 
tableaux, and hence so do their principal specializations: 



(1.10) 



*A(W,...,« n ) = £« 5:<r< 



where T runs over all (reverse) column- strict-tableau T of shape A with entries in 
{0,1, ... ,n}. It will be shown in Section 6.3 that 



(1.11) 



S x (l,t,t 2 ,...,t n ) 



£wt(T;g,t). 

T 



Here T runs over the same set of tableaux as in (1.10), and wt(T; q, t) has a simple 
product expression, showing that for integers q > 2 it is a polynomial in t having 
nonnegative coefficients, and that 



(1.12) 



lim wt(T; q,t) = q 



- „£ 4 T i 



and lim wt(T; q, t ^ ) = 



1.5. Hilbert series. As mentioned above, when q is a prime power, the g-binomial 
coefficient in (1.1) counts the points in the Grassmannian over the finite field ¥ q , 
that is, the homogeneous space G/Pk where G := GL n (¥ q ) and Pk is the parabolic 
subgroup stabilizing a typical fc-dimensional F g -subspace in F™. This is related to 
its alternate interpretation as the Hilbert series for a graded ring arising in the 
invariant theory of the symmetric group W = 6 n : 



(1.13) 



Hilb(Z[x]^/(Z[x]7),t). 



Here Z[x] := 1\x\, . . . , x n ] is the polynomial algebra, with the usual action of 
W = & n and its parabolic or Young subgroup Wk ■= &k x &n-k, and (Zbx:] 1 ^) 
denotes the ideal within the ring of WVinvariants generated by the py-invariants 
Z[x] 1 ^ having no constant term. The original motivation for our definition of the 
(q, £)-binomial came from its analogous interpretation in [15, §9] as a Hilbert series: 



(1.14) 



Hilb(F 9 [x]^/(F,[ X ]5),t), 



q.L 
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where here the polynomial algebra F g [x] := ¥ q [xi, . . . ,x n ] carries the usual action 
of G = GL n (¥ q ) and its parabolic subgroup Pk- 

1.6. Multinomial coefficients. The above invariant theory interpretations ex- 
tend naturally from binomial to multinomial coefficients. Given an ordered com- 
position a = (ai, . . . , cue) of n into nonnegative parts, one has the multinomial co- 
efficient (™) counting cosets W/W a where W = & n and W a is a parabolic/ Young 
subgroup. Alternatively one can view W as a Coxeter system with the adjacent 
transpositions as generators, and this multinomial coefficient counts the minimum- 
length coset representatives for W/W a . These representatives w are characterized 
by the property that the composition a refines the descent composition (3(w) that 
lists the lengths of the maximal increasing consecutive subsequences of the sequence 
10= (w(l),w(2),...,w(n)). 

Generalizing the multinomial coefficient is the usual q-multinomial coefficient 
which we recall in Section 7. It is a polynomial in q with nonnegative integer 
coefficients, that for prime powers q counts points in the finite partial flag manifold 
G/P a ; here G = GL n (¥ q ) and P a is a parabolic subgroup. One also has these two 
interpretations, one algebraic, one combinatorial: 

= Hilb( Z[x] w V( z M+ ) >*) = H 

weW: 
a refines f3(w) 

where £(w) denotes the number of inversions (or Coxeter group length) of w. We 
will consider in Section 7 a (q,t) -multinomial coefficient with two interpretations 
g-analogous to (1.15): 

= Hilb( F 9 [x] p °/(F g [x]«) ,t) = Yl wt(«;;g,t). 

q-t wEW: 

a refines 0(w) 

Here wt(w;q,t) has a product expression, showing that for integers q > 2 it is a 
polynomial in t with nonnegative coefficients, and that 

(1.17) limwt(w;q,t) = q e( - w 1 and lim wt(w; q, t*^) = t l( - w) . 

t— >1 q— >1 

1.7. Homology representations and ribbon numbers. The previous inter- 
pretations of multinomial coefficients are closely related, via inclusion- exclusion, to 
what we will call the ribbon, q-ribbon, and (q,t) -ribbon numbers for a composition 
a of n: 

r a := \{w€W:a = 0(w)}\, 
r a (q):= ^ q^\ 

w£W: 
ol—(3{w) 

r a (q,t):= ^ ^(w,q,t). 

weW: 
a—f3(w) 

It is known that the ribbon number r a has an expression as a determinant involv- 
ing factorials, going back to MacMahon. Stanley gave an analogous determinantal 
expression for the q-ribbon number r a (q) involving q- factorials. Section 9 discusses 
an analogous determinantal expression for the (q, £)-ribbon number, involving (q, t)- 
factorials. 



(1.15) 



(1.16) 
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The ribbon number r a can also be interpreted as the rank of the only non- 
vanishing homology group in the a-rank-selected subcomplex of the Coxeter com- 
plex for W = & n - This homology carries an interesting and well-studied ZW- 
module structure that we will call \ a . This leads (see Theorem 10.4 and Re- 
mark 10.5) to the homological/algebraic interpretation 

(1.18) r a (t) = Hilb( M/Z[x]^M ,t) 

where M is the graded ZfxJ^-module Homzw (x a ; ^[ X D which is the VF-intertwiner 
space between the homology VF-representation x a an d the polynomial ring Z[x]. 

For prime powers q, Bjorner reinterpreted r a (q) as the rank of the homology in 
the a-rank-selected subcomplex of the Tits building for G = GL n (¥ q ). Section 10 
then explains the analogous homological/algebraic interpretation: 

(1.19) r a (q,t) = Hilb( M/Fjx^M ,t) 

where M is the graded F g [x] G -module Homf q a(Xq , ^<?[ x ]) which is the G-intertwiner 
space between the homology G-representation \% on the a-rank-selected subcom- 
plex of the Tits building and the polynomial ring F 9 [x]. This last interpreta- 
tion generalizes work of Kuhn and Mitchell [9], who dealt with the case where 
a = 1" := (1,1,..., 1) in order to determine the composition multiplicities of the 
Steinberg character of GL n (¥ q ) within each graded component of the polynomial 
algebra ¥ q [x] . 

1.8. The coincidence for hooks. In an important special case, there is a coin- 
cidence between the principal specializations S\(l, t,t 2 , . . .), and the (g,t)-ribbon 
numbers r a (q,t). Specifically, when A = (m, l fc ) (a hook) and a = (l k ,m) (the 
reverse hook), we will show in Section 11 that for n > k one has 



m + n 
n — k 



r a (q,t q ~ ). 

q,t 



(1.20) S A (1, t,tV..,t n ) = 

In particular, when k = 0, both sides revert to the (q, i)-multinomial 

L Jq,t 

and when n — k, one has the coincidence S\(l, t, t 2 , . . . , t k ) = r a (q, t), generalizing 
the case a = l k studied by Kuhn and Mitchell [9]. 



m + n 
n 
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(2.1) 



2. Making sense of the formal limits 
Recall the definition of the (g, t)-multinomial from (1.2): 



k\ q ,t-{n-k)\ 



q,t V >'q,ti 



TT _____ 
11 l _ ifl * 



where nl q , t := (1 - t 9 " -1 )^ - t« B -«)(l - t q "- q ) • ■ ■ (1 - t 9 "" 9 " )• We pause to 
define here carefully the ring where such generating functions involving q and t 
live, and how the various formal limits in the Introduction will make sense. 
Let 

t :=(..., t q ,t q , t, t q , t q , . . .) 
be a doubly- infinite sequence of algebraically independent indeterminates, and let 

Q(t) :=Q(...,^>~\m 9 > 2 ,...) 

denote the field of rational functions in these indeterminates. We emphasize that q 
here is not an integer, and there is no relation between the different variables t q ' . 
However, they are related by the Frobenius operator ip acting invertibly via 

Q(t) Q(t) 

We sometimes abbreviate this by saying f(t) f(t q ) and f(t) *£— > 
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Most generating functions considered in this paper are contained in the subficld 
)o of Q(t) generated by all quotients j^r ~: t qr ~ qB of the indeterminates. For 
example, 



■q,t 



t J \ t ql J V ti 



lies in this subficld Q(t)o, and hence so does the (q, i)-binomial coefficient. 

Because the t q are algebraically independent, the homomorphism i 
that sends t q ^ t r is well-defined, and restricts to a homomorphism 



Jo — 

( 2 - 2 ) , . t* r 

It is this homomorphism which makes sense of the q — * 1 formal limits that ap- 
peared in the Introduction: when we write lim^i [F(q, t)]^ for some element 

F(q,t) G Q(t), we mean by this the element in Q(t) which is the image of F(q,t) 
under the homomorphism in (2.2). 

To make sense of the t — > 1 formal limits, choose a positive integer q > 2. The 
field of rational functions Q(t) in a single variable t lies at the bottom of a tower 
of field extensions 

obtained by adjoining a q th root at each stage. The union \J r>0 Q(t q r ) is a rm g 
with a specialization homomorphism from the ring Q(t) defined above: 

Q(t) — > |J Q(t«~ r ) 

(2.3) r>0 

t qr ^t qr . 

Note that in (2.3), the symbol "t q " has two different meanings: on the left it is 
one of the doubly-indexed family of indeterminates, and on the right it is the (q r ) th 
power of the variable t. Many of our results will assert that various generating 
functions F(q,t) in Q(t), when specialized as in (2.3), have image lying in the 
subring Z[t] C {J r >oQ(t q ); this is what is meant when we say F(q,t) in Q(t) "is 
a polynomial in t for integers q > 2". In this situation, we will write lim t ^i F(q,t) 
for the result after applying the further evaluation homomorphism Z[i] — > Z that 
sends t to 1. 

In Section 6, we shall be interested in working with n variables x\, . . . ,x n , rather 
than just the single variable t. To this end, define Q(x) to be the n-fold tensor 
product Q(t) <S> ■ ■ ■ <S> Q(t), renaming the variable t as Xi in the n th tensor factor. 
Here the Frobenius automorphism (p acts by (ipf)(xi) = f{x\, . . . ,x q l ). There are 
various specialization homomorphisms from Q(x) — + Q(t), but the one that will be 
of interest here is the principal specialization Q(x) — > Q(t) sending x q i — > (t^) 1 ^ 1 , 
and abbreviated by f{x\, . . . , x n ) i — > /(l, t,t 2 , . . . , t n ^ 1 ). 

3. Why call it a "binomial coefficient" ? 



We give two reasons for the name u (q, £)-binomial coefficient" . 
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3.1. Binomial theorem. The elementary symmetric function e r (xi, . . . ,x n ) can 
be denned by the identity Y\" = i(y+Xi) = Y^=o y Se «-s( x ) m ^[Vi xi,. . . , x n ]. When 
specialized to x,- t = t 1 ^ 1 this gives the following version of the t-binomial theorem: 



t 



(V). 



(3.1) H(y + 1*- 1 ) = y s cn- s (i, t,t 2 ,..., t™- 1 ) - y s 

On the other hand, a special case of Macdonald's 7th variation on Schur functions, 
to be discussed in Section 6, are polynomials E r (x\, . . . , x n ) which can be defined 
by the following identity in in Fqfxi, . . . , x ni y] (see [10, Chap. I, §2, Exer. 26, 27], 
[11, §7]): 

n 

(3.2) [] (2/ + ^(x))=5> 9 X- s (x). 

<?(x)e(F")* s=0 

Here the product runs over all F ? -linear functional l{x\, . . . , x n ) on F™. We will 
later prove a formula (6.7) for the specialization Xi = t 1 ^ 1 in E r (x), from which 
(3.2) gives the following identity valid in ¥ q [t,y]: 



(3.3) J] {y + t{ht,t\...,t n - 1 )) = Y J y q 

£(x)e(F»)* s=0 



n 

q,t .,=1 



t q -t q 



Although (3.3) does not have a rigorous limit as q approaches 1, it can viewed as a 
g-analogue of the i-binomial theorem (3.1). 

3.2. Binomial convolution. Consider three algebras of generating functions. The 
first two are the power series rings Q[[y]], Q(<?)[[y]] in a single variable y with coeffi- 
cients in the field Q or in the rational function field Q(q). The third is an associative 
but noncommutative algebra, isomorphic as Q(t)-vector space to Q(t)[[y]] so that 
it has a Q(t)-basis {1, y, y 2 , . . .}, but with its multiplication twisted 1 as follows: 

f(t)y k -g(t)/ :=/(*) g(t"")y k+l . 

Each of these three algebras, has a divided power basis {y^} n >a as a vector space 
over Q (resp. Q(g),Q(t)), defined by 



y 



(n) 



IT 



resp. 



y 



v 



{q;q) n n! 9>t , 

One can readily check that the various binomials give the structure constants for 
multiplication in this basis: 



y W yW 



k + £ 

k 



(k+e) 



resp. 



k + e 
k 



y 



(k+e) 



k + £ 
k 



y 



(k+e) 



q.l 



Therefore one has a binomial convolution formula: the product A(y)B(y) of two 
exponential generating functions A(y) := J2 k>Q at y^ k \B(y) := J2e>ot>£ nas 
its coefficient of j/™-* given by 



k+i=n 



(?)afc 6/ ( resp- I a k(l) Mq), 



k+e=n 



k+e=n 



a k {t) b e {t q ') 



g,t 



^his is the twisted semigroup algebra for the mulitplicative semigroup {1, y,y 2 , . . .}, in which 
the semigroup acts on the coefficients Q(t) by letting the generator y act as ip. 
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4. Pascal relations 



Our starting point will be the (q, t) -analogue of the two g-Pascal relations for 
the g-binomial; see e.g. [8, Prop. 6.1], [21, §1.3]: 



(4.1) 



n- 1 
fc-1 



+q K 



n-l 
k 









i 




J 9 


k 


n — 


1 




n — 1 






k- 


1 


+ 

9 


k 


9 



Proposition 4.1. If < k < n, 



(4.2) 



9,< 



9,t 



n-l 
fc-1 

n-l 
k - 1 



+ 



q,tl 



k\ 



q.L 



n — 1 
k 

n — 1 
fc 



9,* ? 



Proof. Both relations are straightforward to check; we check here only the second. 
We will make frequent use of the fact that 



(4.3) 



n!,, t = (l-t«"- 1 )-(n-l)!,, t ,. 



Starting with the right side of the second relation in (4.2), one checks 



= t q '~- q 



n — 1 
fc-1 



fc! 



q,t" 



Mq,t 



q,t" 
(n - l)\q,ti 



n — 1 
fc 



(fc - l)\ q , t *{n - k)\ q tqk 



+ 



klq, t i (n-l)!,,t« 



k\ q . t k\ q , t v{n-k-l)\ qtq k+ 



(n - l)l q .tl 



t Q -q I 
+ 



(fc-l)! g , t .(n-fc-l)! git ,*+i \ l-ti n -i k l-ti"- 1 



(n-l)l 9 ,t« 



1 - 1« 



(fc - l)!, it ,(n - fc - l)!, it ,*+i (1 - to n -i k )(l - 



q.l 



□ 



Note that the quotient k ^ ,tq appearing in both (q, t)-Pascal relations (4.2) factors 
as follows: 



(4.4) 



k\ q jl 
~kJqJ 



where [N] t := 1 1 * t = l + t + t 2 + ■ ■ - + t N 1 . Consequently, if q is a positive integer, 
this quotient is a polynomial in t with nonnegative coefficients. 



is a polynomial in t with non- 



q,t 



Corollary 4.2. If q > 2 is an integer, then 
negative coefficients. 

Proof. This follows by induction on n from either of the (q, t)-Pascal relations, using 
(4.4). □ 

Remark 4.3. Note that taking the formal limit as t — > 1 in either of the (q, i)-Pascal 
relations (4.2) leads to the same g-Pascal relation, namely the first one in (4.1). On 
the other hand, replacing t with t~ and then taking the other formal limit as 
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q — ► 1 in the two different (q, t)-Pascal relations (4.2) leads to the two different 
g-Pascal relations in (4.1). 

5. Combinatorial interpretations 

Our goal here is to explain the combinatorial interpretation for the (q, t)-binomial 
described in (1.5): 

\ =^2^t(^,q,t) 

- -U.t A 

where the sum runs over partitions A whose Ferrers diagram fits inside a k x (n — k) 
rectangle, that is, A has at most k parts, each of size at most n — k. 

5.1. A product formula for wt(X;q, t). The weight wt(X;q,t) actually depends 
upon the number of rows k of the rectangle in which A is confined, or alternatively, 
upon the number of parts of A if one counts parts of size 0. To emphasize this 
dependence upon k, we redefine the notation wt(A; q, t) := wt(A, k; q, t). This weight 
will be defined as a product over the cells x in the Ferrers diagram for A of a 
contribution wt(x, A, k; q, t) for each cell. To this end, first define an exponent 

e k (x) := q^+tW - q d W 

where r(x) is the index of the row containing x, and d(x) is the taxicab (or Man- 
hattan, or L 1 -) distance from x to the bottom left cell of the rectangle, that is, the 
cell in the k th row and first column. Alternatively, d(x) = content (x) +k — l, where 
the content of a cell x is j — i if x lies in row i and column j. Then 
(5.1) 

t e k{x) [g] tefc(x) if x is the bottom cell of A in its column. 
[<7] t e fc (x) otherwise. 



wt(x, A, k; q, f) :- 

wt(A, k; q, t) := J^J wt(x, A, k; q, t). 



Example 5.1. Let n = 10 and k = 4, so n — k = 6. Let A = (4, 3, 1, 0) inside the 
4x6 rectangle. The cells x of the Ferrers diagram for A are labelled with the value 
d(x) below 

3 4 5 6 • • 
2 3 4 ••• 
1 



and wt(A, k; q, t) is the product of the corresponding factors wt(x, A, k; q, t) shown 
below: 



[olti*-* 3 Wit* 5 -** [i} t * e -* 5 tq7 q6 W\ t * 7 

[qU- q - to 5 -i 3 [q} tg s_ q3 t^'^[q} tq e_ qi 



t q - q [qU- q i 

One can alternatively define wt(A, k; q, t) recursively. Say that A fitting inside a 
k x (n — k) rectangle has a full first column if A has k nonzero parts; in this case, 
let A denote the partition inside afcx (n — k — 1) rectangle obtained by removing 
this full first column from A. 
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Proposition 5.2. One can characterize wt(X,k;q,t) by the recurrence 
wt(A, k; q, i) = 



t q 1 -^pT" wt(A, k; q, t q ) if X has a full first column, 



wt(A, k — 1; q, t q ) otherwise, 
together with the initial condition wt(0, k;q, t) := 1. 

Proof. This is straightforward from the definition (5.1) and equation (4.4). □ 

Theorem 5.3. With the (q,t) -binomial defined as in (1.2) andwt(X,k;q,t) defined 
as above, one has 



= ^wt(A,fc;q,i) 
<?>* A 

where the sum ranges over all partitions X whose Ferrers diagram fits inside a 
k x (n — k) rectangle. 
Furthermore, 

(5.2) limwt(A, k;q,t) = <? |A| and lim wt(A, k; q, t^) = t w . 

t— >1 g— >1 

Note that this gives a second proof of Corollary 4.2. 

Proof. The first assertion of the theorem then follows by induction on n, comparing 
the first (q, i)-Pascal relation in (4.2) with Proposition 5.2; classify the terms in the 
sum J2 X wt(A, k; q, t) according to whether A does not or does have a full first 
column. 

The limit evaluations in the theorem also follow by induction on n, using the 
following basic limits: 

lim[gl, r+<i_ <i = q, lim< 9 ~ q = 1 

(5 3) ^ 

lim ([q] tq r +d _ qd ) _^=1, \im(t qr+d - qd ) x = t r , 



9 

and hence 



} ln l Ti — = 1 ' 

t^ 1 k\ q ,t 



(5.4) 

9^1 V kl q .t / ,_ ir -r 



lim [ ^ ) = t k . 



□ 



In the remainder of this section, we reformulate Theorem 5.3 in two other ways, 
each with their own advantages. 

5.2. A different partition interpretation. First, note that (2.1) implies that 
for fixed k > one has 



lim 

n — >oo 



=n I 

11 1 „ 4-q k -q k ~ l ' 

q,t i=i 

For integers q > 2, this is the generating function in t counting integer partitions \i 
whose part sizes are restricted to the set {q k — 1, q k — q, . . . , q k — q k ~ 1 }. One might 
ask whether there is an analogous result for the case where n is finite, perhaps by 
imposing some restriction on the multiplicities of the above parts in fi. This turns 
out indeed to be the case, as we now explain. 
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Definition 5.4. Given A a partition with at most k nonzero parts, set A^+i = 0, 
and define for i = 1, 2, . . . , k 

Ai-l 

5i(X):= ? =<I Xi+1 [\-\+i] q - 

For an integer q > 2, say that a partition /i is q-compatible with A if the parts of /x 
are restricted to the set {q k — 1, q k — q, . . . , q k — q k ~ 1 }, and for each i = 1,2, ... ,k, 
the multiplicity of the part q k —q k ~ l lies in the semi-open interval [<5,(A), 5i(X)+q Xi ). 

For example, if n = 5, k = 2 and A = 31, the partitions fi which are g-compatiblc 
with A are of the form [i = (q 2 — q) mi (q 2 — l)" 12 where 

q 1 + q 2 < mi < q 1 + q 2 + q 3 - 1, 1 < m 2 < q. 

It turns out that yu determines A in this situation: 

Proposition 5.5. Given a partition /i with parts restricted to the set {q k — q k ~ t } k = i, 
there is at most one partition A having k nonzero parts or less which can be q- 
compatible with [i. 

Proof. Recall that \k+i = 0. Then for i — k, k — 1, . . . , 2, 1, check that the multi- 
plicity m, of the part q k — q k ~ l in determines A^ uniquely, by downward induction 
on i. □ 

Theorem 5.6. 

k 



(5.5) 



Q,t A i=l 

where the sum ranges over all partitions A fitting inside a k x (n — k) rectangle. 
Consequently, for integers q>2, 



(5.6) 



where the sum runs over partitions /i which are q-compatible with a A that fits inside 
a k x (n — k) rectangle. 

Proof. Equation (5.6) follows immediately from equation (5.5). The latter follows 
from Theorem 5.3 if one can show that 

wt(A, *;«,*) = f[(ti k -i k -*) s ^ [ q ^] tqk _ qk ^. 

i=l 

This would follow from showing that for each row i = 1,2, . . . ,k m. \, one has 
(5.7) J] wt(x, A, k; q, t) = (t^-^) 8 ^ [q x % qk ^-, . 

xeX: 
r(x)—i 

This is not hard. The left side of (5.7) is easily checked to equal 

{ t<l ~ q ) <5,(A) M t ,0( g fc-,fc-»)[g] t ,l (g fc-,fc-») • • • [<l] tq *i-l( q k- q k-iy 

Repeated apply to this expression the identity 

[M]q ■ [N] QM = [MN]q, 

k k — i 

with Q = t q ~ q and N — q each time, and the result is the right side of (5.7). □ 
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Note that by setting t = 1 in (5.6), one obtains a new interpretation for the 
usual g-binomial coefficient, as the cardinality of a set of integer partitions, rather 
than as a generating function in q: 



Corollary 5.7. For integers q>2, the the integer 



is the number of partitions 



q- compatible with a A that fits inside a k x (n — k) rectangle. 

5.3. A subspace interpretation. The g-binomial coefficient is the number of k- 
spaces of an n-space over a finite field with q elements; see e.g. [8, §7], [21, Prop. 
1.3.18]. We give in Theorem 5.9 a statistic on these subspaces whose generating 
function in t is the (q, i)-binomial coefficient. 

Fix a basis for the n-dimensional space V over F 9 . Relative to this basis, any 
fc-dimensional subspace U of V is the row-space of a unique matrix k x n matrix 
A over ¥ q in row-reduced echelon form. This matrix A will have exactly k pivot 
columns, and the sparsity pattern for the (possibly) nonzero entries in its nonpivot 
columns have an obvious bijection to the cells x in a partition A inside a k x (n — k) 
rectangle; call these |A| entries of A the parametrization entries for U. 

10 and k = 4 one possible such row-reduced echelon form 



Example 5.8. If n 

could be 



U 



where each * is a parametrization entry representing an element of the field ¥ q . 
The associated partition A = (4, 3, 1, 0) fits inside a 4 x 6 rectangle, and is the one 
considered in Example 5.1 above: 



* 



To define the statistic s(U), first fix two bijections (fro 



,91- 



4>o 



{0,1,. ..,9-1} 



{1,2,. ..,«}. 

For each parametrization entry of A, define the integer value vu(aij) to be 
<t>i(aij) or (j)o(aij), depending on whether or not (i, j) is the lowest parametrization 
entry in its column of A. Then define 

du(i, j) ■= k — i + j — |{pivot columns left of j}\ — 1 

s(U) := J2MaijM +du{i ' j) -q du(l - j) ) 
(id) 

where the summation has (i, j) ranging over all parametrization positions in the 
row-reduced echelon form A for U . 



Theorem 5.9. If q is a prime power then 
(5.8) 



9.* U 



s(U) 
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in which the summation runs over all k-dimensional ¥ q subspaces U of the n- 
dimensional ¥ q -vector space V. 

Proof. This is simply a reformulation of Theorem 5.3. When the parametrization 
entry dij of A corresponds bijectively to the cell x of A, then one has i = r(x), 
du(i,j) — d(x), and (i,j) is the lowest parametrization entry in its column of A if 
and only if x lies at the bottom of its column of A. From this and the definition 
(5.1), it easily follows that wt(A, k;q, t) — J2 u t s ^ as U ranges over all subspaces 
whose echelon form corresponds to A. □ 



6. Generalization 1: principally specialized Schur functions 

We review here some of the definition and properties of Macdonald's 7th varia- 
tion on Schur functions, and then lift them from polynomials with ¥ q coefficients 
to elements of the ring Q(x). We then show (Corollary 6.7) that, for integers q > 2, 
the principal specializations of these rational functions are actually polynomials in 
a variable t with nonnegative integer coefficients, generalizing the (q, £)-binomials. 



6.1. Lifting Macdonald's finite field Schur polynomials. Macdonald's 7 th 
variation on Schur functions from [11, §7] are elements of F g [x] := F 9 [xi, . . . ,x n ] 
defined as follows. For each a = (a>i, . . . , a n ) 6 N™, first define antisymmetric 
polynomials 

A Q (x) :=det(af% =1 . 
Let 8 n := (n — 1, n — 2, . . . , 1, 0). Given a partition A = (A x > • • • > A„), define 

A x+Sn (x) 



Sa(x) := 



which is a priori only a rational function in F g (x), but which Macdonald shows is 
actually a polynomial lying in F g [x]. Since both Aa+<5„(x) and A$ n (x) are anti- 
symmetric polynomials, their quotient Sa(x) is a symmetric polynomial in the Xi. 
Macdonald shows that Sa(x) enjoys the stronger property of being invariant under 
the entire general linear group G = GL n (¥ q ). 

Definition 6.1. Recall from Section 2 that Q(x) = Q(t)® n where Q(t) was defined 
there, with Frobenius automorphism ip acting by (ipf)(xi) = f(x\, . . . ,x^). First 
define 

A Q (x) :=det(xf j )l j=1 
regarded as an element of Q(x), and then define 

A A+5„ (x) 



Sa(x) := 



A 5n (x) 



in Q(x). Even after specializing to integers q > 2 this will turn out not to be a 
polynomial in general. We will be interested later in its principal specialization, 
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lying in Q(t): 



det 



S x (l,t,t 2 ,...,t n ~ 1 ) = 



(6.1) 



det((^ +B " < ) i - 1 )" 

<•«•«("•' • 1 ):;/', 

0<j<j<n-l 



Here the last equality used the Vandermonde determinant formula. 

Define the analogue of the complete homogeneous symmetric function h r by 
(6.2) H r (x) =S (r) (x) 

for r > 0, and H r (x) = for r < 0. 
Theorem 6.2. For integers n > k > 0, 

H(„_fe)(l, t, ■ ■ ■ , t k ) = 



g,t 



Proof. When A = (A , . . . , A fe ) = (n — ft, 0, . . . , 0), the last product in (6.1) 



s A (i,t,...,t*)= n 

0<i<j<fe 



>fc + l_i+i 



will have the numerator exactly matching the denominator in all of its factors except 
those with j = ft. This leaves only these factors: 



n 

0<i<k 



t q 



tl - fl % 



q,t 



□ 



6.2. Jacobi-Trudi formulae. Macdonald also proved Jacobi-Trudi-style determi- 
nantal formulae for his polynomials S\, allowing him to generalize them to skew 
shapes A//x. We review/adapt his proof here so that it lifts to Q(x), giving the 
same formula for S A (x). 

Theorem 6.3. (Jacobi-Trudi) For any partition A = (Ai, . . . , A„) 
S A (x)^d e % 1 ^H Ai _ 4+ ,(x)^ =1 ) 

Proof, (cf. [11, §7]) For convenience of notation, we omit the variable set x from 
the notation for H, A, S A etc. The definition of H r says that 

n+r-l „n-2 „™-3 



(6.3) 



H r := S( r ) = A^ 1 • det 



q 

x\ xi 

q 1 

x\ X 2 
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Expanding the determinant along the first column shows that 

n 

(6.4) H r ( X )=J2^ n+r ~ 1 (xk)-u k 

k=l 

where u k in Q(x) do not depend on r. For a = (a>i, . . . , a„), write down equation 

(6.4) for r = on — n + j for i = 1, 2, . . . , n, and apply ip 1 ^^ for j = 1, 2, . . . , n, giving 
the n x n system of equations 

n 

p 1 - 1 K ai _ n+j = f az ( x k) ■ V X ~ 3u k- 

fe=l 

Reinterpret this as a matrix equality: 

(^ 1 ^H Qi _ n+J )" j=1 = {^{x k ))l k=1 ■ (ip^u^l^ 
Taking the determinant of both sides yields 

(6.5) det n ai _ n+j )l j=1 = A a B 

where B := det (ip l ~^UkYl . One pins down the value of B by choosing a = S n 
in (6.5): then cti — n + j = j — i, so the left side becomes the determinant of an 
upper unitriangular matrix, giving 

1 = A.g n B 

and hence B = Aj\ Thus (6.5) becomes 

det (tp 1 -* H ai _„ +j )™ = ^L. 

"-On 

Now taking a = A + S n yields the theorem. □ 

Theorem 6.3 shows that S\(x) is the special case when fi = of the following 
"skew" construction. 

Definition 6.4. Given two partitions 

A = (Ai, . . . , A^) 

A 1 = (Mi, ■■■,IJ-l) 

with fii < Aj for i = 1, 2, . . . , £, the set difference of their Ferrers diagrams X/^i is 
called a skew shape. Define 

(6.6) S x/ll (x):=det(^-«-Vn Xi _ H _ i+j ) 

\ / i,j= 1,2,...,£ 

In the special case where /i = and A is a single row of size r, note that 
S( r )(x) = H r (x), consistent with (6.2). 

In the special case where /x = and A = V is a single column of size r, define 

E r (x) :=S ( ir)(x), 

and set E r (x) := for r < 0. The following analogue of Theorem 6.2 is proven 
analogously: 

(6.7) E r (l,t,t 2 ,...,t n - V ) = 



n 
n — r 



n 

a.t „■ i 



t" 



t<i" 
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In [11, §9] Macdonald explains how in a more general setting, one can write down 
a dual Jacobi-Trudi determinantal formula for Sa/ m (x), involving the conjugate or 
transpose partitions A', pi! and the E r instead of the H r . 

Proposition 6.5. 

S A/M (x) :=det (^^-iE A ,_^._ i+j (x)).. =i>2 y 

Proof. We sketch Macdonald's proof from [11, §9] for completeness, and again, 
omit the variables x from the notation for convenience. We first prove that, for any 
interval / in Z, the two matrices 

Ej:= ((-irV^ 

arc inverses of each other. Since both Hj.Ej are upper unitriangular, this will 
follow if one checks that for i, k e I with i < k one has 

k 

or equivalently, after applying <p z and re- indexing k — i =: r, 

r 

$^(-l)V -i H J -f^ E r-j = 0. 

But this is exactly what one gets from expanding along its top row the determinant 
in this definition: 

E r = det (^'Hi_^)y =1 . 

Once one knows that Hj,Ej are inverses of each other, and since they have 
determinant 1 by their unitriangularity, it follows that each minor subdctcrminant 
of Hj equals the complementary cofactor of the transpose of Ej . One can check that 
for each X/p, there is a choice of the interval I and the appropriate subdctcrminant 
so that this equality is the one asserted in the proposition; see [10, Chap. 1, eqn. 
(2.9)]. □ 

Our goal in the next section is to describe a combinatorial interpretation for 
Sa(1, t, ■ ■ ■ , t n ) in terms of tableaux, which will imply that for integers q > 2 this 
polynomial in t has nonnegative coefficients. 

6.3. Nonintersecting lattice paths, and the weight of a tableau. The usual 
skew Schur function sw^(x) has the following well-known combinatorial interpre- 
tation (see e.g.[ll, §1.5], [22, §7.10]): 



(6.8) s x/ll (x 1 ,...,x n ) = ^2 



T 

X 



where T runs over all reverse column-strict tableaux of shape X/fi with entries in 
{1,2, ... ,n}. Here a reverse column-strict tableaux T is an assignment of an entry 
to each cell of the skew shape X/fi in such a way that the entries decrease weakly 
left-to-right in each row, and decrease strictly from top-to-bottom in each column. 
The monomial x T := Y[i x Ti as i ranges over the cells of A/ 'pi. 

There is a well-known combinatorial proof of this formula (see [21, Theorem 
2.7.1] and [22, §7.16]) due to Gessel and Vicnnot. This proof begins with the 
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Jacobi-Trudi dctcrminantal expression for sa/^j reinterprets this as a signed sum 
over tuples of lattice paths, cancels this sum down to the nonintersecting tuples of 
lattice paths, and then shows how these biject with the tableaux. 

Note that (6.8) implies the following interpretation for the principal specializa- 
tion of s a/m : 

s x/fi (l,t,...,t k ) = ^t^ Ti 

T 

where T ranges over the reverse column-strict tableaux of shape A//i with entries 
in {0,1,..., k}. Our goal is to generalize this to S w^l, t, . . . , t k ), using the Gessel- 
Viennot proof mentioned above. 

We begin by recalling how lattice paths biject with partitions and tableaux, in 
order to put the appropriate weight on the tuples of lattice paths. We start with 
the easy bijections between these three objects: 

(i) Partitions v inside a k x r rectangle. 

(ii) Lattice paths P taking unit steps north (N) and east (E) from (x,y) to 
(x + r, y + k). 

(iii) Reverse column-strict tableaux of the single row shape (r) and entries in 
{0,1,..., k}. 

The bijection between (i) and (ii) sends the lattice path P to the Ferrers diagram 
v(P) (in English notation) having P as its outer boundary and northwest corner at 
(x, y + k). The bijection between (ii) and (iii) sends the lattice path P to the tableau 
whose entries give the depths below the line y = k of the horizontal steps in the path 
P. For example, if k — 4, r — 5 then the partition v = (4,4, 1,0) corresponds to 
the path P whose unit steps form the sequence (N, E, N, E, E, E, N, N, E), which 
corresponds to the single-row tableau T = 32220; see Figure 6.3(a). 

Given any skew shape A//z, the bijection between (ii) and (iii) above generalizes 
to one between these two sets: 

• All ^-tuples (Pi, . . . , Pi) of lattice paths, where Pi goes from (^ — (i — 1), 0) 
to (Aj — (i — 1), k), and no pair Pi, Pj of paths touches, that is, the paths 
are nonintersecting. 

• Reverse column strict tableaux of shape X/fi with entries in {0, 1, ... , k}. 

Here the bijection has the i th row of the tableaux giving the depths below the line 
y = k of the horizontal steps in the i th path Pj. For example, if k = 4 and t — 3 
with X/fi = (8, 6, 5)/(3, 2, 0), then the tableau T of shape X/fi having entries in 
{0,1,2,3,4} given by 

• • -3 2 2 2 
T = ■ -4211 
2 1110 

corresponds to the 3-tuple (Pi,P 2 ,P3) where 

Pi is the path from (3, 0) to (8, 4) with steps (N, E, N, E, E, E, N, N, E) 

P 2 is the path from (1, 0) to (5, 4) with steps (E, N, N, E, N, E, E, N) 

P 3 is the path from (-2, 0) to (3, 4) with steps (N, N, E, N, E, E, E, N, E) 

as depicted from right to left in Figure 6.3(b). 

Given such a tableau T corresponding to the tuple of paths (Pi, . . . , P{), and 
letting v{Pi) be the partition within a rectangle of width k that has Pi as its outer 
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(b) 



• to* 



'J 



4 #-^r* • t • 
f-^i | 2 * 2 * 2 * • 



Figure 1 . (a) The lattice path corresponding to the partition z/ = 
(4,4,1,0) inside a 4 x 5 rectangle, or to the single-row tableau 
T = 32220 with entries in {0, 1, 2, 3, 4}. (b) From right to left, the 
3-tuple (Pi,P 2 ,P3) of nonintersecting lattice paths corresponding 
to the tableau T described in the text. 



boundary as before, define 



(6.9) wt(T; q, t) := JJ ^i-(i-i) wt(i/(Pj), k; q, t). 

i=l 

In the next proof, we will use the fact that for a lattice path P and a cell x of v(P), 
the distance dp(x) which appears in the formula (5.1) for wt(x, v(P), k; q, t) is the 
taxicab distance from the starting point of path P to the cell x. 

Theorem 6.6. 

S A/M (M,--- ,t k ) =^wt(T; 9 ,t) 

T 

where the sum ranges over all reverse column-strict tableaux T of shape X/fi with 
entries in {0,1, ... ,k}. 
Furthermore, 

(6.10) limwt(T;g,t) = q^* Tl and lim wt(T; q, t^) = t^* Ti . 

t— »1 q— >1 

Proof. We recapitulate and adapt the usual Gessel-Viennot proof alluded to above, 
being careful to ensure that the weights behave correctly in this context. 
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Starting with the definition (6.6), and using Theorems 6.2 and 5.3 to replace 
occurrences of H r , one has 

S A / M (l,t,"- ,i fe ) = det(^-«- 1 ) H A( _ w _ i+j ) w =i,2,...,/ 

= £ 8gn(«,)II^)>W-i)H A) _ M() . j+ „ (j) (l ) t **) 

= ^ sgnHlJ^w-^w-^wtK^i), *;«,*)• 
(u>,(Fl,...,p*)) »=1 

The last summation runs over pairs (w, (Pi, . . . , Pj?)), where w is a permutation 
in &£, and (Pi, . . . , P^) is an £-tuple of lattice paths where Pi goes from (fj, w ^ — 
(w(i) - 1),0) to (Aj - (i - l),fc). 

One wants to cancel all the terms in the last sum above that have at least one 
pair (Pj,Pj) of intersecting lattice paths. In particular, this occurs if w is not 
the identity permutation. Therefore all terms remaining will have w equal to the 
identity, and the paths (Pi, . . . ,Pg) nonintersecting. Note that these leftover paths 
have the correct weight wt(T;q,t) for their corresponding tableau T, as given in 
the theorem. 

The Gessel-Viennot cancellation argument involves tail-swapping. One cancels 
a term (w, (Pi, . . . , Pi)) with another term having equal weight and opposite sign. 
One finds this other term, say by choosing the southeasternmost intersection point 
p for any pair of the paths, and choosing the lexicographically smallest pair of 
indices i < j of paths Pj, Pj which touch at p. Then replace w by w' :— w ■ (i,j), 
and replace the pair of paths (Pj,P,) with the pair of paths (Pj,P/), in which P[ 
(resp. Pj) follows the path Pj up until it reaches p, but then follows Pj (rcsp. Pj) 
from that point onward. 

One must check that this replacement does not change the weight, that is, 

«.w-M0-i) wt(i/(P<), k; q, t) • »W)-(™0')-i) wt(u(Pj), k; q, t) 

(6.11) = /.'w-W*)- 1 ) wt(f(Pj), fc; g, i) • <^/( 3) -(«>'0)-i) w t(^(P/), jfc; g, i) 

= ^w-^W-i) w t(zy(P/), fc; q, t) ■ ^w-W)- 1 ) wt(z/(Pj), k; q, t). 

This follows by comparing how each cell x of v{Pi) (or of v{Pj)) contributes a 
factor of the form ip m wt(x, f (P), k; q, t) to the products on the left and right sides 
of (6.11). There are two cases. If x is a cell of either v(Pi) or v{Pj) lying to the 
left of the point p, then it will contribute the same factor on both sides. If x is a 
cell of v(Pi) lying to the right of p, then it contributes 

^W-^W-i) w t(x, u(Pi),k;q,t) on the leftmost side of (6.11) and 

wt(x, v(P-),k;q,t) on the rightmost side of (6.11). 

However, we claim there is an equality 

^«,(0-Mi)-i) wt ^ ^ p .) 5 fc . ^ ^ = wt ^ 5 fc; ^ 

Definition (5.1) shows that the exponent ek(x) := g r ( x )+ dp ( x ) — ^H*) determining 
the powers of t appearing in wt(x, v(P), k; q, t) will be computed with the same 
row index r(x), whether one considers x inside v(Pi) or inside v(Pj). However, the 
distance dp 4 (x) from x to the start of Pi is H w {j) — ^ w (i) ~ w {i) + W U) ^ ess than 
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its distance dp>(x) to the start of Pj. This difference is exactly compensated by 
the difference in the Frobenius power which will be applied: ^^Mo-f^W -1 ) versus 
^Mwoo-OO')- 1 ) . The argument is similar for a cell of v(Pj) lying to the right of p. 
Thus the two terms have the same weight, and opposite signs: sgn(w') = — sgn(w). 

One can check that this bijection between terms is an involution, and hence it 
provides the necessary cancellation. □ 

Corollary 6.7. If q > 2 is an integer, then S\(l,t,--- ,t k ) is a polynomial in t 
with nonnegative coefficients. 

Proof. Use Theorem 6.6. We wish to show that when \i = 0, for every column- 
strict tableau T of shape A = X/^i, every factor in the product formula for wt(T; q, t) 
given by (6.9) is a polynomial in t with nonnegative coefficients for q > 2 an integer. 

The key point is that fi = means the sequence of nonintersecting lattice paths 
(Pi, P 2 , • • • , Pi) corresponding to T will start in the consecutive positions 

(0,0),(-l,0),(-2,0),...,M+l,0). 

For each i, this forces the path Pi to start with at least i — 1 vertical steps, in order 
to avoid intersecting the next path Pj_i. Hence the corresponding partition shape 
v(Pi) will be missing at least i — 1 boxes in its first column. Consequently, in the 
product formula for wt(T;q,t) given by (6.9), one can rewrite each factor 

^-C" 1 ) wt(^P), k; q, t) = ^-i) wt(i/(Pi), k; q, t) 

= wt(u(Pi),k-(i-iy,q,t) 

where the last equality uses i — 1 times repeatedly the second case of the recurrence 
in Proposition 5.2. The formula for wt(u(Pi),k — (i — l);q,t) given in (5.1) then 
shows that it is a polynomial in t with nonnegative coefficients whenever q > 2 is 
an integer. □ 

Example 6.8. The two skew shapes 

(2,l) = (2,l)/(0,0)=* X and (2,2)/(l,0) = x ^ 

have the same ordinary Schur functions, and hence the same principal specializa- 
tions 

s(2,i)(i,3) = s(2,2)/(i,o)(i,g) = q 1 + q 2 

corresponding to either the two reverse column-strict tableaux 

10 1 

T2 ~Q 

or the tableaux 



Ti=J ° T 2 =\ 1 of shape (2,1) 



T{= Q I T! 2 = 1 J ofshape(2,2)/(l,0). 

We compare here what the preceding results say for 

[/H 2 (l,t) p" 1 !^!,*)" 



s (2,i)/(o,o)(M) = S( 2 ,i)(M) = dct 



¥>°H (l,t) ip^H^t) 



= [1 + q + q 2 ] tq -i ■ [1 + q] q _i - [1 + q + q 2 + q 3 } ^ 

t i t i 

= t + t 2 + i 3 +t 4 + t 5 + t 6 when q = 2, 
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versus 



S(2,2)/(i,o)(l>*) — det 



^H (l,i) ¥ j- 1 H 2 (l,t)_ 

,2 



= [1 + g] t , ( ,_i) • [1 + g + g 2 ] - [1 + q + q 2 + q d ] a=i 

t " t i 

= f 2 +ti +t 3 + t 4 + 1§ + t 5 when q = 2. 

Note that S(2,i)(l,t) 7^ S(2,2)/(i,o)(l>*)- Both are elements of Q(t) and can be 
rewritten as weighted sums over tableaux, according to Theorem 6.6: 

S(2,i)/(o,o)(l, t) = wt(T i; q, t) + wt(T 2 ; g, t) 

= t"- 1 [q] t ,- 1 +11-^-1 ■t* 2 -i[q] tg 2_ Q 
= (t + t 2 ) + (t 3 + 1 4 + t 5 + t 6 ) when q = 2, 
versus 

S(2,2)/(i,o)(l,*) = wt(T[;q,t) + wt(T 2 ;g,f) 

= t« 2 -i[q] tq2 _ q +t <?-<i[q] tq ._ q •i 1 -'M tl -i 

= (t 2 + t 4 ) + (ft + i 3 + £ + i 5 ) when g = 2. 

Lastly, note that that S( 2j i)(l, t) is a polynomial in t (with nonnegative coefficients) 
for integers q > 2, as predicted by Proposition 6.5, but this is not true for the skew 
example S (2;2)/(1;0 )(l, i). 



7. Generalization 2: multinomial coefficients 

We explore here a different generalization of the (g, t)-binomial coefficient, this 
time to a multinomial coefficient that appears naturally within the invariant theory 
ofGL„(F 9 ). 

7.1. Definition. Given a composition a = (ai, . . . , at) of n, define its partial sums 
a s := «i + a 2 + • • • + a s , so that cr = and let 



where 



n 




r n 


Q 




ai, 




a! 9 


t := ai! 9)t 



Note its relation to the (g, t)-binomial 



as well as these formulae: 



n 




n 


k 


g,t 


k,n — k 



q,t 



(7.1) 



q.l 



n 


g,t 


n 


q.t 



n — ot\ 
a 2 , ■ ■ ■ ,a.£ 



n — a\ 
a.2 



q,t 
01 



q,t 



n — ai — a.2 
a 3 



q,t 
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Equations 7.1 along with Corollary 4.2 imply that for integers q > 2, the (q,t)- 
multinomial is a polynomial in t with nonnegative coefficients. As with the (q, t)- 
binomial, it has two limiting values given by the usual q-multinomial coefficient: 



lim 


n 




n 




t 


^1 


a 


q,t 


a 












9 


lim 


n 






n 




9-1 


a 


i 

q,t i- 1 


a 


t 



7.2. Algebraic interpretation of multinomials. We recall here two algebraic 
interpretations of the usual multinomial and q-multinomial that were mentioned in 
the Introduction, and then give the analogue for the (q, t)-multinomial. 

The symmetric group W — & n acts transitively on the collection of all flags of 
subsets 

=: S a C Si C • • • C S t -x C S e := {1,2,..., n} 

in which \Si\ = o~i. The stabilizer of one such flag is the Young or parabolic subgroup 
W a which permutes separately the first ot\ integers, the next «2 integers, etc. Thus 
the coset space W/W a is identified with the collection of these flags, and hence 
has cardinality [W : W a ] = (™). When q is a prime power, the g-multinomial 
analogously gives the cardinality of the finite partial flag manifold G/P a where the 
group G = GL n (¥ q ) and P a is the parabolic subgroup that stabilizes one of the 
flags of F g -subspaces 

{0} =: V C Vi C • • • C V e -i C V e := F™ 

in which dimF g Vi = &{. 

On the other hand, one also has parallel Hilbert series interpretations arising 
from the invariant theory of these groups acting on appropriate polynomial algebras. 
In the case of the (q, t)-multinomial this is where its definition arose initially in work 
of the authors with D. White [15, §9]. 

Let Z[x] := Z[xi, . . . ,x n ] carry its usual action of W = 6 n by permutations of 
the variables, and let F g [x] :=¥ q [xi, . . . , x n ] carry its usual action of G = GL n (¥ q ) 
by linear substitution of variables. The fundamental theorem of symmetric functions 
states that the invariant subring Z[x] w is a polynomial algebra generated by the 
elementary symmetric functions ei(x), . . . , e„(x). A well-known theorem of Dickson 
(see e.g. [1, §8.1]) asserts that the invariant subring F ? [x] G is a polynomial algebra; 
its generators can be chosen to be the Dickson polynomials, which are the same as 
Macdonald's polynomials -Ei(x), . . . , E n (x) discussed in Section 6 above. It is also 
not hard to see that, for any composition a of n, the invariant subring Z[x] Wa is a 
polynomial algebra, whose generators may be chosen as the elementary symmetric 
functions in the first ct\ variables, then those in the next 012 variables, etc. The 
following result of Mui [13] (see also Hewett [5]) is less obvious. 

Theorem 7.1. For every composition a of n, the parabolic subgroup P a has invari- 
ant subring ¥ q [x] Pa isomorphic to a polynomial algebra ¥ q [f\ , . . . , /„] . Furthermore, 
the generators fi, ■ ■ ■ , f n ma V be chosen homogeneous with degrees q as — q a ^ 1 for 
s = 1 , . . . , £ and i = 1 , . . . , a s . 
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Corollary 7.2. For every composition a of n, 

n\ _ Hiib(z[x] w °,t) 

(7.2) 



Hilb(Z[x]w, t ) 



q,t 



_ Hilb(F,[x] F °,t) 
— Hilb(F,,[xp,t) • 



Furthermore, Z[x] a ,F 9 [x] a are free as modules over over Z[x] , F g [x 
spectively, and hence 



]GL„ 



re- 



(7.3) 



= mib(z[x] M/ °/(z[x]f),t) 

= Hilb(F 9 [x]^/(F 9 [x]G), t ). 



Proof. The Hilbert series for a graded polynomial algebra with generators in degrees 



d 1 



Hence the multinomial expressions (7.2) for the quotient of 



Hilbert series follows in each case from consideration of the degrees of the generators 
for Z[x] w ,Z[x] w °,W q [x] G ,W g [k\ p <*. 

For the re-interpretations in (7.3), one needs a little invariant theory and com- 
mutative algebra, such as can be found in the book by Benson [1] or the survey 
by Stanley [20]. When two nested finite groups H C G act on a Noetherian ring 
R, the invariant subring R H is finitely generated as a module over R G . If R G is a 
polynomial subalgebra, this means its generators will form a system of parameters 
for R H . When R H is also polynomial, it is Cohen-Macaulay, and hence a free mod- 
ule over the polynomial subalgebra generated by any system of parameters. In this 
situation, when the rings and group actions are all graded, a free basis for R H as 
an i? G -module can be obtained by lifting any basis for R H /{R G ) as a module over 
the ring R G / R G (which equals F g or Z in our setting). Therefore 



m\h(R H ,t) 
m\h(R G ,t) 



mib(R H /(R G ),t). 



□ 



Remark 7.3. It should be clear that the above Hilbert series interpretation of 
the (q, i)-multinomial generalizes the u q = 1" interpretation of the t-multinomial. 
It turns out that it also generalizes the interpretation of the g-multinomial as 
[G : P a ] — \G/P a \ when t = 1, for the following reason: when two nested finite 
subgroups ffcGc GL n (k) act on fc[x], one always has (see [1, §2.5]) 



,. Hilb(fc[x 
t" i Hilb(fc[x 



H 



t) 



= [G : H}. 



8. The (q, £)-analogues of q e ^ 

Corollary 7.2 interprets the (q, i)-multinomial algebraically when one specializes 
q to be a prime power. Our goal here is a combinatorial interpretation valid in 
general, generalizing Theorem 5.3. 

Given a composition a of n, recall that W = & n has a parabolic subgroup W a 
whose index [W : W a ] is given by the multinomial coefficient (™) . Viewing W as a 
Coxeter group with the adjacent transpositions {i, i + 1) as its usual set of Coxeter 
generators, one has its length function £(w) defined as the minimum length of w 
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as a product of these generators. This is well-known to be the inversion number, 
counting pairs 1 < i < j < n with w(i) > w(j). 

There are distinguished minimum-length coset representatives W a for W/W a : a 
permutation w lies in W a if and only if a refines its descent composition (5(w) — 
(ft, . . . ,ft). Recall that (3(w) is the composition of n defined by the property that 

w(i) > w(i + 1) if and only if i £ {ft, ft + j3 2 , . . . , ft + ft + ■••+ft-i}. 

Rephrased, f3(w) lists the lengths of the maximal increasing consecutive subse- 
quences of w — (w(l),w(2), . . . , w(n)). 

It is well-known (see [21, Prop. 1.3.17]) that 



(8.1) 



= \W a \ 



wew a 

We wish to similarly express the (q, ^-multinomial as a sum over w in W a 
of a weight wt(w;q, t), simultaneously generalizing (8.1) and Theorem 5.6. The 
weight wt(w; q, t) will be defined recursively in a way that generalizes the defining 
recurrence for wt(A, k; q, t) in Proposition 5.2 . 

Recall that when a = (k,n — k) has only two parts, there is a bijection A <-► u\ 
between partitions A inside a k x (n — k) rectangle and the minimum length coset 
representatives u\ in W a , determined by 

u\(i) = Xk+i-i + i - 1 for i = 1, 2, . . . , k. 

Now given any permutation w in W — & n , if k is defined by w _1 (l) = k + 1, then 
taking a = (k,l,n — k — 1), one can uniquely express 

w = u\ ■ a ■ e ■ b 



with 



where 



£{w) = l(u x ) + 1(a) + 1(b) 



u x e w {k ' n - k ^ = si k ' n ~ k \ 
a G 6{i,2,...,fc} = &k, 

e e 6{ fe+1 j = ©i (so e is the identity permutation of {k + 1}), 

b E 6{fe+2,fe+3,...,n} — ©n-fc-l- 

Note also that in the above factorization w = u\aeb 7 by the definition of k, one 
knows that A has its first column full of length k. Let A denote the partition inside 
a k x (n — 1 — k) rectangle obtained from A by removing this first column, so that 

n . . ^(k,n— 1 — k) 

u x lies in & n _ 1 

Definition 8.1. For w £ & n , define wt(w; q, t) in Q(t) recursively to be 1 if n = 1, 
and otherwise if w _1 (l) = k + 1 set 

(8.2) wt(w;q,t) := t^ 1 ^ • wt(« x ; q, t q ) wt(a; g, t) wt(6; q, t qk+1 ) 

Example 8.2. Let n — 8 and choose 

'1 2 3 4 5 6 7 



w 



5 2 7 4 1 3 8 6 
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Then k + 1 = w = 5, so that k = 4, and the above factorization is 
w = u\ ■ a ■ e ■ b 

_ A 2 3 4 | 5 | 6 7 8\ A 2 3 4\ /5\ /6 7 8\ 
" ^2 4 5 7 | 1 | 3 6 8/^3 1 4 2) ' \h) ' \p 8 7J ' 

Here A = (3, 2, 2, 1), so that A = (2, 1, 1,0) and 

_ (I 2 3 4 | 5 6 7\ 
? ^™l v 1 346|257j- 

Then the recursive definition says 

wt(w; g, t) 

:= t? 4 - 1 ^ • wt(« x ; g, i«) wt(o; g, t) wt(6; g, V?) 

: = ^M^-ife]^ -,[<?] ^-,2 M t5 4 -,3 • wt(u 3v ;g,t ,J )wt(a;g,t) wt(6;g,t« 5 ). 
where we regard b as an element of S3. 

Proposition 8.3. Given any w in & n , the weight wt(w;q,t) for integers q > 2 is 
a polynomial in t with nonnegative coefficients, taking the following form 

i(w) 

wt(w;q,t) = t x Y[[q] tq vi- q *i 

i=l 

for some nonnegative integers x, yi, Zi with yi > Zi for all i. Furthermore, 
(8.3) limwt(w;g,t) = q e(w) and lim wt(w; g, t^) = t l{w) . 

t— *1 q— >1 

Proof. For all of these assertions, induct on £(w), using the fact that 

£{w) = £(u x ) + £(a) + £(b) 

= k + £(u x )+£(a)+£(b) 
along with the recursive definition (8.2), equation (4.4), and the limits in (5.3). □ 

We first show that this recursively defined wt(w; q, t) coincides with wt(A, k; q, t) 
when w — u\. 

Proposition 8.4. For any partition \i inside a k x (n — k) rectangle, one has 
wt(w M ; g, t) — wt(/x, k; g, t). Consequently, 

= wt(u M ;g,t). 

Proof. One checks that wt(«^;g, t) satisfies the same defining recursion (5.2) as 
wt(/x;g,i). Temporarily denote 

wt(u M , k; q, t) := wt(w M ; g, t) 

to emphasize the dependence on k. The fact that w — lies in w( fc > n_fe ) implies 
either u>~ 1 (l) = /j + lorl, depending upon whether or not fi has its first column 
full of length k. In the former case, one can check that the recursion (8.2) gives 

k k\ 

wt(u^,k;q,t) = t q ■ wt(u A , k; q, t q ) 

Kl q ,t 



n 
k 
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and in the latter case that it gives 

wt(u^,k;q,t) =wt(u/x,k- l;q,t q ), 

as desired. Thus the equality wt(u M , k; q, t) = wt((i, k; q, t) follows by induction on 
n. 

The last assertion of the proposition is simply the restatement of Theorem 5.3. 

□ 

In order to generalize Proposition 8.4 to the (q, £)-multinomial, it helps to have 
a multinomial (q 7 t)-Pascal relation. 

Proposition 8.5. For any composition a — (a\, . . . , at) of n, with partial sums 
a s = J2i=i a s (and ctq : = 0), one has 



(ai,a 2 , ■ ■ ■ ,ai_i)! 9) 



n — 1 

ai, . . . , ai-i, a, - 1, a i+1 , . . . ,a n 



(ai,a 2 , • • ■ ,a»-i)! 5 ,i 

where we recall that a! 9it := ai\ q . t ■ u 2 \ q tq °i ■ a 3 \ q tq "2 ■ ■ ■ at\ ° u-i ■ 

Proof. Induct on £, with the base case I = 2 being the first of the two (q, t)- 
Pascal relations from Proposition 4.1. In the inductive step, write a = (ai,a) 
where a := {a%, ■ ■ ■ ,at) is a composition of n — a\. Beginning with (7.1), start 
manipulating as follows: 



q,t 



q,t 

n — 1 
a\ — 1 



n — a\ 
a 



q,t 



+ t1 



q,tl 



■i-l "l!;,ti 



n—1 
a x 



n — a\ 
a 



q,t 



n-1 
ai — 1 



q,tl 



n — a\ 
a 



+ 



q,t 



t" 



"l_l<ll'g,t« 

ai\ q .t 



n-1 



q.tl 



n — OL\ 

a 



q,t 



q,t" 



The first summand is exactly 

n—1 
ai — 1, a 

which is the i = 1 term in the proposition. If one applies the inductive hypothesis 
n — a\ 
a 

multiplied by the other factors in the second summand, these give the desired 
remaining terms i = 2, 3, . . . , £ in the proposition. □ 



to 



in the second summand, one obtains a sum of I — 1 terms. When 



q,t 



Theorem 8.6. For any composition a of n, and W = & n , 



= wt(w;q,t). 

Proof. Induct on n, with the base case n—1 being trivial. If a = (a\, . . . , at) then 
one can group the terms in the sum on the right into the subsums 

(8.4) Yl wt( W ;g,t) 

«)- 1 (l)= C r I _ 1 + l 
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for i = 1, 2, . . . , £. Introducing the following notations 



fc 
a' 
a" 



0~i-l 



= (ai, a 2 , ■ ■ ■ , oti-i) 

= (ai - l,a i+ i,a i+ 2, ■■■,ai) 



we wish to show that the subsum (8.4) equals the following term from the right 
side of Proposition 8.5: 



(8.5) 



t" 



n — 1 



Note that when w (1) = fc + 1, the recursive definition of wt(w; q, t) says 
wt(w;q,t) = t q " 



1 k[q - tq ■ wt(u; g, t 9 ) wt(o; g, i) wt(6; g, t«* +1 ) 



fc! 



where u € 6^1™ 1 k \a € &% , 6 G ©"-i-^- Thus one can rewrite (8.4) as 
^-1^*1 £ wt(«;«,t») 2 E wt(6;g,^ +1 ) 



fc! 



= t 9 



1 ^'g,* 9 


n - 1 




"fc" 




n — 1 — fc 




fc, n — 1 — fc 


q,t" 




9,t 


a" 



bees 



q-t q 



-i (»~l)! g ,t" 
a'!g it a"! gt<! fe+i 



n — 1 

a', a" 



g,*i 



in which the first equality replaced all three sums; Proposition 8.4 was used to 
replace the first sum, while the inductive hypothesis was used to replace the second 
and third sums. □ 



9. Ribbon numbers and descent classes 

Recall that the minimum-length coset representatives W a for W/W a are the 
permutations w in W = & n whose descent composition (5(w) is refined by a. The 
set of permutations w for which fi(w) = a is sometimes called a descent class. We 
define in terms of these classes the ribbon, q-ribbon, and (q,t) -ribbon numbers for a 
composition a of n: 

r a := \{w E W : a = 0(w)}\, 
r a (q):= £ q^ w \ 

(9.1) a=/3(w) 

r a (q,t):= E wt ( w ; 

weW: 
a—f3(w) 

Recall that the partial order by refinement on the 2"" 1 compositions a of n is 
isomorphic to the partial order by inclusion of their subsets of partial sums 



{ai,ai + a 2 , ■ ■ ■ , aH h ae-i}. 
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From (8.1) and Theorem 8.6 it should be clear that there is an inclusion-exclusion 
relation between these three kinds of the ribbon numbers and three kinds of multi- 
nomials (ordinary, q-, and (q, t)-multinomials). 

However, it turns out that the inclusion-exclusion formula for the ribbons col- 
lates into a determinantal formula involving factorials. This determinant for ribbon 
numbers goes back to MacMahon, for g-ribbon numbers to Stanley (see [21, Exam- 
ples 2.2.5]), and for (q, i)-ribbon numbers is new, although all three are proven in 
the same way; see Stanley [21, Examples 2.2.4,2.2.5]). 

Proposition 9.1. For any composition a = (a\, . . . ,ag) of n, with partial sums 
Oi := ^2j—i ctj, one has 

n\ det 



r a = 



E 



(3 refined by a 

r«(«) = £ {-lf a) ' m 

j3 refined by a 



{(Jj -CTi-l)\ 



r a (q,t)= J2 

{3 refined by a 



— [n]\ q det 



(«) 



1/ i,j=l 



n\ q t det ip 



q.l 



((Jj - CTi-l)!g, t 



where \m]\ c 



1(1 + <?)(! + q + q 2 ) ■ ■ ■ (1 + q + q 2 + ■ ■ ■ + q" 1 ' 1 ). 



By the definition (9.1), it is clear that r a is nonnegative, that r a (q) is a poly- 
nomial in q with nonnegative coefficients, and that for integers q > 2 one will have 
r a (q, t) a polynomial in t with nonnegative coefficients. It should also be clear that 

lim r a (q) = r a 

g->l 

lira r a (q,t) = r a (q) 
lim r a (q,t^) = r a {t). 

Our goal in the next section will be to interpret these three ribbon numbers homo- 
logically. 



10. HOMOLOGICAL INTERPRETATION OF RIBBON NUMBERS 

The ribbon number r a has a well-known interpretation as the rank of the only 
non- vanishing homology group in the a-rank-selected subcomplex A(W, S) a of the 
Coxeter complex A(W, S) for W — 6 n . For prime powers q, a result of Bjorncr 
[2, Theorem 4.1] analogously shows that r a (q) is the rank of the homology in the 
a-rank-selected subcomplex of the Tits building A(G, B) for G = GL n (¥ q ). 

Here we use Bjorner's results to give, in parallel, Hilbert series interpretations 
for r a (t),r a (q,t). These interpretations will be related to graded modules of Horn 
spaces between the homology representations on A(W, S) a or A(G, B) a and appro- 
priate polynomial rings. This generalizes work of Kuhn and Mitchell [9], who dealt 
with the case where a = (1, 1, . . . , 1) =: l n , in order to determine the (graded) 
composition multiplicities of the Steinberg character of G within the polynomial 
ring F g [x]. 
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Definition 10.1. Let W := & n and G := GL n (F q ). Given a composition a of n, 
define the virtual sum of induced ZW^-modulcs 

(10.1) X«:= £ (-l)««M<fllj* 

(3 refined by a 

and F g G-modules 



(10.2) *»:= E {-lf {a) - m l 

(3 refined by a 



These virtual modules have been considered by Bjorner, Bromwich, Curtis, 
Mathas, Smith, Solomon, Surowski, and others; see [2], [12] and [17] for some 
of the relevant references. In the special case where a — 1™ is a single column with 
n cells, x° is t ne sign representation of W, and \q is the Steinberg representation 
ofG. 

For any composition a of n, these virtual modules x a an d Xq turn out to be 
genuine ZW and ZG-modules. They can be defined over the integers because they 
are the representations on the top homology of the (shellable) simplicial complexes 
A(W / , S) a and A(G, B) a , which are the rank- selection (or type- selection) of the Tits 
building A(G, B) to the rank set given by the partial sums {ct s } s= i j ... i £_i; see [2, §4]. 
Note that top-dimensional homology groups are always free as Z-modules because 
they are the group of top-dimensional cycles; there are no boundaries to mod out. 

In what follows, we will make several arguments about why certain algebraic 
complexes 

r , d i+1 di „ 
••• ► Oi+i > ► > ■ ■ ■ 

are not only acyclic, but actually chain- contractible, that is, there exist maps back- 
ward Cj+i Ci for each i with the property that 

A-i^i + d i+1 Di = lc^ 

We will use repeatedly the following key fact. 

Proposition 10.2. If one applies an additive functor to a chain- contractible com- 
plex, the result remains chain- contractible. 

Proof. If the complex is called (C,d*) and the functor called F, then the maps 
F{D{) provide a chain-contraction for (F(C), F(d*)): additivity and functoriality 
imply 

F(D i . 1 )F(i i )t%i)F(A) = 1f(c 4 ) 
if F is covariant, and a similar statement if F is contravariant.. □ 

The following key fact was proven by Kuhn and Mitchell for a — 1"; we simply 
repeat their proof for general a. 

Theorem 10.3. Given a composition a of n, the simplicial chain complex for the 
type-selection A(W, S) a or A(G, B) a gives rise to chain- contractible complexes of 
ZW or ¥ q G-modules 

<ia3) O-tf-C 
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where the typical term in C takes the form 

or 

j3 refined by a: 
/3 refined by a: 

Proof. We give the proof for the case of the Tits building A(G, B); the u q = 1 case" 
for A(W, S) is even easier. 

First note that \q includes in the first (top) chain group as the kernel of the 
top boundary map, setting up the complex of ZG-modules in (10.3). It remains to 
prove that it is chain-contractiblc after tensoring with ¥ q . 

Bjorner [2], Kuhn and Mitchell [9], and Smith [17] have observed that the shelling 
order which one uses for the Tits building (or any of its rank-selections) can actually 
be chosen 5-equi variant: one can shell the facets bwP a in any order that respects 
the ordering by length of the minimal coset representative w € W/W a , and the 
.B-action never alters this representative w. This means that the resulting chain- 
contraction maps can be chosen as Z£>-module maps. 

Since [G : B] is coprime to the prime p (= the characteristic of ¥ q ), if one 
tensors the coefficients with the localization Z( p ) at the prime p (i.e. inverting all 
elements of Z coprime to p), one can start with these Z( p ) B- module maps, and 
average them over the cosets G/B to obtain Z( p ) G- module maps that still give a 
chain-contraction. 

Lastly, one can tensor the coefficients with ¥ q and obtain the desired F 9 G-module 
chain-contraction. □ 

Given an ¥ q G- module ip, one can regard the F 9 -vector space HomF 5 G('0j^g[ x ]) 
as an F«j[x] G -module: given / in F g [x] G , and a G-equivariant map h : ip — > F 9 [x], 
the map fh that sends u £ ip to / • h{u) is also G-equivariant. 

We come to the main result of this section, whose assertion for ©^representations 
is known in characteristic zero; see the extended Remark 10.5 below. 

Theorem 10.4. Given a composition a of n, the l,[x] w -module 

M :=Homw( X a ,Z[x]) 

is free over Z[x] w , with 

Hilb(M/Z[x]^M,i) = r a (t). 
Analogously, for q a prime power, the ¥ q [x] G -module 

M:=Hom F?G (^,F 9 [x]) 

is free over ¥ q [x] G , with 

Hilb(M/F,[x] G M,t) =r a (q,t). 

Proof. As with the previous theorem, we give the proof only for the assertions about 
G; the proof for the assertions about W are analogous and easier. 

Start with the chain-contractible F 9 GL„-complex from Theorem 10.3. Applying 
the functor Homj ii G/ /n (— , F q [x]) to this, one obtains (via Proposition 10.2) a chain- 
contractiblc complex of F«j[x] G -modules that looks like 

C' M -> 
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and where the typical term in C is a direct sum of terms of the form 

Hom F , G (lG ,F g [x])-Fjxp. 

Since every ring Fg[x] P|8 is a free F g [x] G -module by Corollary 7.2, this is actually 
a free F 9 [x] G -resolution of M. Thus it can be used to compute Tor F " M (M,¥ q ): 
tensoring C over F 9 [x] G with F g gives (via Proposition 10.2) a chain-contractiblc 
complex C" of F 9 -vector spaces, whose homology computes this Tor. But since the 

complex C" is chain-contractiblc, Tor^ (M,F 9 ) vanishes for i > 0, that is, M is 
a free F g [x] G -module, giving the first assertion of the theorem. 

For the second assertion, note that the resolution C of the F<j[x] G -module M 
shows 

Hilb(M,t) = (-l) £(a) ~ £(/3) Hilb(F 9 [x] p ^,i). 

/3 refined by a 

Since M and every one of the F^xJ^'s are all free as F 9 [x] G -modules by Corollary 
7.2, one can divide both sides by Hilb(F 9 [x] G , t) to obtain 

Hilb(M/F, H jM, t )= £ 

refined by a 



(3 refined by a 

r a (q,t). □ 



□ 



Remark 10.5. We sketch here how the assertion in Theorem 10.4 for W = &„ follows 
from known results in the literature, when one considers CW-modulcs rather than 
ZVF-modules; see Roichman [16] for generalizations and more recent viewpoints on 
some of these results. 

It is known from work of Hochster and Eagon (see [20, Theorem 3.10]) that 
for any CW-module %, the Horn-space M x := Honiciy(X) C[x]) is always free as a 
C[x] w -module. One can compute its Hilbert series via a Molien series calculation 
[20, Theorem 2.1] as 



Hilb(M x ,i) = — V - * H - 
v ' ' n\ ^ det(l - tw) 



(10.4) 



= s x (l,t,t 2 



Here X(w) denotes the partition of n that gives w's cycle type, P\(xi,X2, ■ ■ •) is 
the power sum symmetric function corresponding to A, and s x (xi,X2, ■ • ■) is the 
symmetric function which is the image of the character \ under the Frobenius 
characteristic map from 6„-characters to symmetric functions. Thus one has 

Hilb(M*/C[x]^M*,i)- Hilb (^V) 



mb(C[x\ w ,t) 

(t;t) n s x {l,t,t 2 ,...). 
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When x is a skew- character x X ^ °f &n, then s x = s\/^ is a skew Schur function, 
and one has the explicit formula [22, Proposition 7.19.11] 

(10.5) (i; t)n *a/ m (1. *, t 2 , ■ ■ ■) = / A/M W := E * maKQ) 

Q 

where Q runs over standard Young tableaux of shape A//z, and maj(Q) is the sum 
of the entries i in the descent set defined by 

Des(Q) := {i G {1, 2, . . . , n — 1} : i + 1 appears in a lower row of Q than i}. 

Given a composition a = (a.\, . . . , ag), the CVF- module x a on the top homology of 
the subcomplex A(W, S) a turns out to be the skew-character f° r the ribbon 
skew shape A//i having ctj cells in its i th lowest row: Solomon [18] used the Hopf 
trace formula to express the homology representation x a as the virtual sum in 
(10.1), and this can then be re-intepreted as the Jacobi-Trudi formula for the skew- 
character of this ribbon skew shape. Consequently, if M := M x then 

Hilb(M/C[x]^M,i) = J2 t maj(Q) = J2 i maj(w) = J2 t e(w) =r a {t). 

Q:\(Q)=a i»66„: i»£6„: 

f3(w) — a (3(w)—a 

Here the second equality uses a well-known bijection that reads a standard tableaux 
Q filling the ribbon shape and associates to it a permutation w in W having descent 
composition (i(w) = a, while the third equality is a well-known result of MacMahon 
(see e.g., [4]). 



11. The coincidence in the case of hooks 

As mentioned in the Introduction, there is an important coincidence that occurs 
in the special case of the principal specialization of Sa when A is a hook shape 
(to, 1*), leading to a relation with the (q, t)-ribbon number for the reverse hook 
composition a = (1*, to). 

We begin with a simplification in the product formula for the principal special- 
ization when A is a hook. 

Proposition 11.1. For n> k, 



~1 ' - t J. 

<p n ~ k S( m) i*)(l,t, • • • ,t k ). 

q,t 

Proof. The second equation is a consequence of the first. The first equation is a 
straightforward consequence of (6.1), deduced similarly to the proof of Theorem 6.2 
and equation (6.7). □ 

This implies the following relation, that we will use below for an induction. 

Corollary 11.2. 

d,t,t 2 ,...,n + s (l,t,t , . . . ,t n ) 

= H TO (l,i, t 2 , ...,t n )- Efe(l,t, t 2 , . . . ,t™ _1 ) 



n - 
n 



TO 

- k 



i-k 



t q 



n 



t q> 



n + m 
n — k 
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Proof. Apply Proposition 11.1 to the left side: 



S( m ,i*)(l,M i • • • ,t n ) + S/ m+1 !*-!)(!, t, t ,...,t n ) 



n + m 


n 


-k 


n 


■f m 


n 


-k 


n 


+ m 


n 


- k 


n 


+ to 


n 


-k 


n 


■f m 




n 



jn — k 



n 



^ i=i 

n — & / / 



5,t 



n — k 



n 









+ 


n + m 








n — k 


f 






+1 )S 






- t 


f 






-i 





n — k 



fe-1 g m+fc _ ^ 



n 



n — /c 



q,t i=i 
- i j 



t<? 1 - t 



m + k 
k 



n 

n — k 



q,t 



n 

■ Z— 

fe 

n 



g,t i=i 



-i« 

^ - f 



— H m (l,i, t 2 , . . . ,t n ) ■ E fc (l,i, i 2 , . . .,t n l ). 
The last equality used (6.7). 

Theorem 11.3. 



□ 



S( TO ,i*)(l,i, t 2 , ...,t n ) — 



m + n 
n — k 



q,t 



Proof. By the second equation in Proposition 11.1, it suffices to prove this in the 
case n = k, that is, 



(11.1) 



S (m,i fc )(M> t 2 , ■■ -,t ) = r^k m )(q,t). 



Let LHS(m, k), RHS(m, k) denote the left, right sides in (11.1). We will show they 
are equal by induction on k; in the base case k = both are easily seen to equal 1. 

For the inductive step, note that Corollary 11.2 gives the following recurrence 
on k for LHS(m, k): 



LHS(m, k) = -LHS(m + 1, k - 1) + 



to + k 
k 



LHS(l,k-l). 



q,t 



To show RHS(m, k) satisfies the same recurrence, start with the summation ex- 
pression for RHS(m, k) given in Theorem 10.4: 



RHS(m,k) = Yl (-if+^-m 

(3 refined by (l k ,m) 



m + k 

a 



q,t 



Classify the terms indexed by (3 in this sum according to whether the composition 
f3 ends in a last part strictly larger than to, or equal to m. The former terms 
correspond to compositions (3 refined by (l fe_1 ,TO + 1), and their sum gives rise to 
the desired first term —RHS(m + l,k — 1) in the recurrence. The latter terms 
correspond, by removing the last part of (3 of size m, to compositions (3 refined by 
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1 , and their sum is 



f3 refined by (1 ,m) 
ending in m 



m + k 



q,t 



m + k 
k 

m + k 
k 



q,t 



q,t 



refined by l fc 

RHS(l,k- 1), 



that is, the desired second term in the recurrence. 



□ 



Remark 11.4. Note that equation (11.1), together with Theorem 10.4, gives the 
principal specialization S( m t, t 2 , . . . , t n ) an algebraic interpretation in the 
special case n = k. However, this generalizes in a straightforward fashion when 
n > k, as the same methods that prove Theorem 10.4 can be used to prove the 
following. 

Let A := ¥ q [xi, . . . , x m+n ] with its usual action of G m + n := GL m+n (¥ q ). Given 
a a composition of n, consider the induced F g G m+ „-module 

X a q m+n := Ind°™+- X a q 

where one considers the homology representation x q for GL n {¥ q ) as also a represen- 
tation for the parabolic subgroup P( m .„) , via the homomorphism P( m .„) — > GL„(F 9 ) 
that ignores all but the lower right n x n submatrix. 

Theorem 11.5. In the above situation, the A Gm+n -module 

M:=Uom ¥qGm+n ( Xq *> m+n ,A) 

is free over A Gm+n , with 

m\b{M/A Gm+n M,t) = 

When a — (l k ,m), the right side above is S( m . i*)(l, t, t 2 , . . . ,t n ), by Theorem 11.3. 



rn - 
n - 



at 



12. Questions 

12.1. Bases for the quotient rings and Schubert calculus. Is there a simple 
explicit basis one can write down for F g [x] p °/(F 9 [x] ( j ; )? By analogy to Schubert 
polynomial theory, it would be desirable to have a basis when a = 1", containing 
the basis for any other a as a subset. 



12.2. The meaning of the principal specializations. What is the algebraic 
(representation-theoretic, Hilbert series?) meaning of Sx/ jU (l,f, • ■ • , t n ), or perhaps 
just the non-skew special case where /i = 0? Is there an algebraic meaning to the 
elements Sx/^xi, x 2 , ...,x„) lying in Q[x]? 



36 



VICTOR REINER AND DENNIS STANTON 



12.3. A (q,t) version of the fake degrees? The sum appearing in (10.5) is a 
skew generalization of the usual fake-degree polynomial 

where 6(A) = J2i>i (2*)' ana - h(x) is the hook length of the cell x of A; see [22, 
Corollary 7.12.5]. The fake degree polynomial f x (q) has a different meaning when 
q is a prime power, giving the dimension of the complex unipotent representations 
of GL n (¥ q ) considered originally by Steinberg [23]; see [6, 14]. 

Is there a (q, t)-fake degree polynomial f x ^(q, t) e Q(t) having any or all of the 
following properties (a)-(f)?: 

(a) lim t ^i/Vf( g ,t) = /V/*(g). 

(b) Iim fl ^ 1 /VM( g , t ^)=/A/M( t ). 

(c) Better yet, a summation formula generalizing (10.5) of the form 

f x ^(q,t) = J2^(Q;q,t) 

Q 

where Q runs over all standard Young tableau of shape A//x. Here wt(Q; q, t) 
should be an element of Q(t) with a product formula that shows it is a 
polynomial in t with nonnegative coefficients for integers q>2, and that 

limwt(Q;g,f) = g ma KQ) an d lim wt(Q; q, i«=0 = £ maj(Q) . 

t— >1 q— >1 

(Note that property (c) would imply properties (a), (b)). 

(d) A Hilbert series interpretation (/-analogous to (10.5) of the form 

Hilb(M,t)- / A/M M) 



(12.2) ' (l-^"- 1 )(l-t9 n -9)---(l-t9 n -9 n - 1 ) 

= f X ^(q,t)-mb(K[ X f,t) 

Here M should be a graded if[x] G -module (not necessarily free), where K 
is some extension field of ¥ q and G = GL n {¥ q ) acts in the usual way on 
K\x\ := K[x\ 1 . . . , x n ]. Equivalcntly this would mean that 



f X ^(q,t) = ^(-l) l Hilb(Torf {M,K),t). 

i>a 



(e) A reinterpretation of the power series in (12.2) as a principal specialization 
of some symmetric function in an infinite variable set, generalizing (10.5). 

(f) When (i = 0, a product (q 7 t)-hook length formula for f x (q,t) generalizing 
(12.1). 

When A = (m, l fe ) is a hook shape, one can define f x (q,t) := r a (q,t) for 
a = (l k ,m). Then our previous results on r a (q,t) can be loosely re-interpreted 
as verifying properties (a),(b),(c),(d),(f) (but not, as far as we know, (e)). Here the 
desired module M is Homw q G(Xq : ^<?[ x ]); where \q was the homology representa- 
tion on the a- type-selected subcomplex of the Tits building A(G, B) considered in 
Section 10. It is known that this homology representation \q 1S an integral lift of 
the complex unipotent character considered by Steinberg in this case. 
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12.4. An equicharacteristic g-Specht module for ¥ q GL n (¥ q )7 The discussion 
in Section 12.3 and Remark 10.5 perhaps suggests the existence of a generalization 
of the F 9 G-module x% f° r G = GL n (¥ q ) from ribbon shapes a to all skew shapes 

a/a*. 

Question 12.1. Can one find a field extension K of ¥ q and a if G-module Xq^ 
which is a q-analogue of the skew Specht module x X ^ f° r <3„, generalizing the ho- 
mology representation x q = Xg^ when a is a ribbon skew shape as in Remark 10.5, 
and playing the following three roles? 



Role 1. Let X/fi be an arbitrary skew shape. It is known from work of James and 
Peel [7] that any skew Specht modules x X ^ f° r W = & n has a characteristic-free 
Specht series, that is, a filtration in which each factor is isomorphic to a non-skew 
Specht module x v , an d where the number of factors isomorphic to \ v 1S equal to 
the Littlewood-Richardson number = c x v . 

Question 12.2. Does the hypothesized g-skew Specht ifG-module Xq^ from 
Question 12.1 have a if G-module filtration in which each factor is isomorphic to one 
of the non-skew q-Specht modules Xqi an d where the number of factors isomorphic 
to Xq is equal to the Littlewood-Richardson number c v x , ? 

In particular, this would force dim^ (xq^^j = f X ^{q)i an d would answer a ques- 
tion asked by Bjorner [2, §6, p. 207]. It suggests that perhaps there is a construction 
of such a Xq m the spirit of the cross- characteristic q-analogue of Specht modules 
defined by James [6], which also has dimension given by f x {q). 

Role 2. Let X/fi be an arbitrary skew shape. 

Question 12.3. Does the hypothesized module Xq^ from Question 12.1 allow one 
to define the module 

(12.3) M:=Hom F?G ( X ^,F 9 [x]) 

giving a definition for the (q, £)-fake degree f x ^(q, t) as in part (d) of Section 12.3? 

Role 3. Let X/fj, be an arbitary skew shape. It follows from Schur-Weyl duality that 
one can re-interpret the usual Schur function principal specialization as a Hilbert 
series in the following way: 

(12.4) 8x/lt (l, t^ 1 ) := Hilb (Hom w ( X A /A\ t) . 

Here V = C N is viewed as a graded vector space having basis elements in degrees 
(0, 1, 2, . . . , N — 1), inducing a grading on the n-fold tensor space V® n , and W = 6 n 
acts on V® n by permuting tensor positions. 

Question 12.4. Does the hypothesized ifG-module Xq^ from Question 12.1, 
playing the role of x X ^ in (12-4), have a hypothesized accompanying graded KG- 
module V(N,n,q), playing the role of V® 11 in (12.4), so that 

S A/ „(1, t, . . . , t"- 1 ) := Hilb (uom KG ( X X/ ^ V(N, n, q)), t) ? 
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